Question Generation via Overgenerating Transformations and Ranking
نویسندگان
چکیده
We describe an extensible approach to generating questions for the purpose of reading comprehension assessment and practice. Our framework for question generation composes general-purpose rules to transform declarative sentences into questions, is modular in that existing NLP tools can be leveraged, and includes a statistical component for scoring questions based on features of the input, output, and transformations performed. In an evaluation in which humans rated questions according to several criteria, we found that our implementation achieves 43.3% precisionat-10 and generates approximately 6.8 acceptable questions per 250 words of source text.
منابع مشابه
Ranking Automatically Generated Questions as a Shared Task
We propose a shared task for question generation: the ranking of reading comprehension questions about Wikipedia articles generated by a base overgenerating system. This task focuses on domain-general issues in question generation and invites a variety of approaches, and also permits semi-automatic evaluation. We describe an initial system we developed for this task, and an annotation scheme us...
متن کاملRanking Model with a Reduced Feature Set for an Automated Question Generation System
A metric has been proposed to automatically generate well-formed-ness rank for machine generated questions. The grammatical correctness of a question, challenge due to the negation in the source text and number of transformations required to convert an illformed (not appealing to humans) question to a well-formed (meaningful and human appealing) question seem the prominent fea-
متن کاملGood Question! Statistical Ranking for Question Generation
We address the challenge of automatically generating questions from reading materials for educational practice and assessment. Our approach is to overgenerate questions, then rank them. We use manually written rules to perform a sequence of general purpose syntactic transformations (e.g., subject-auxiliary inversion) to turn declarative sentences into questions. These questions are then ranked ...
متن کاملInfluence of heat generation on the phase transformations and impact responses of composite plates with embedded SMA wires
In the present research, in contrast to the available papers, not only the superelasticity but also the shape memory effects are taken into account in determination of the impact responses. At the same time, in addition to modifying Brinson’s model for the shape memory alloys (SMAs), to include new parameters and loading events, and Hertz contact law, distributions of the SMA phases are conside...
متن کاملA Model Transformation-based Technique for Flexible XML Data Source Integration
Current research in domains such as Bioinformatics depends heavily on the integration and processing of information coming from diverse sources, which are typically highly complex and heterogeneous, and require approximate queries based on a ranking method. Processing these sources requires sophisticated query processing techniques, which are based on indexing and optimization techniques which ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009